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ABSTRACT ' 

If one assumes that the purpose of 'education is to 
change student belhavior as a result of some definite Course of 
instruction, then an objective of educational research shoul4 be to: 
determine what procedures. <or techniques best produce the desired 
behavioral changes. If a course has been effective, then there could 
be a large number of components in that course contributing to its 
effectiveness. This. paper defines the instructional setting as 
consisting, of nine components that instructors, instructional 
designers and instructional evaluators would generally agree upon. 
The nine components are (1) an instructional plan, (2) instructional 
materials, (3) instructional methods, (4)" instructional examinations, 
(5) ^instructional evaluations, (6) the students, (7) the! instructor , 
(8) Vmstructor-student interaction,- and (9) the instructional arena. 
Three sources (instructor, departmental ^^er review committee, and 
student) were identified as being necessary to ptpvide evaluative 
inf ornistion on each of the nine components. This paper presents 
examples of appropriate* evaluative statementi^" for students to use so 
as not to confuse their input with that of the instructor and 
departmental peer ireview committee . " (Author/PN) 
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COMPONENTS OF TEACHING AS MEASURED BY STUDENT RATINGS 
Lawrence M. Aleamoni 
University, of Arizona 

' ; • If one assumes that the.purpose o^ education Is to change- studapt behavior 
as a result of some definite course of Instruction, then an objective of 
; educational research should be.to determine what procedures or techniques best 
produce the desired behavioral changes. If a course has 'been effective, then 
there could be a large number of, components in that course contributing to Its 
' effectiveness. / * ^ - 

A 

Although, there «t>pear$ to be some controversy among Instructors end 
instructional evaluators concerning what the actual c6mponents^ of the Instruc- 
tional setting are. my experience Indicates that such «• controversy need not 
exist. If one defines the basic components of the instructional setting as 
consisting of (a) an instructional plan, (b) instructional materiaTs. (c) . 
instructional methods, (d) instructional examinations, (e) instructional 
evaluations, (f) the students, (g) the Instructor, (h) instructor-student 
interaction, and (1) the Instructional arena, then there would be little. If 
any. disagreement between instructors, instructional designers and instruc- 
tional evaluators. 

Some disagreement may surface when each of these components is delineated 
into a more specific subset of components and when specific measures are 
produced for each member of the subset. -The development of these specific 
^ measures, if carefully done, will usually represent a comprehensive as-seSsment 

^ . °^ components of the instructional setting. The major mistake made at 

■0 ' . 

^ this point by those designing an instructional evaluation system is to rely 

0"1y on student -input for. the specif ic measures delineated above. By doing 
this these evaluators are indicating that students are the only acceptable 
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source of Information on the basic com,)onents of the Instructional, ^ttlng. 
This predictably results in a very negative reaction on the part of faculty 

^ho are to be evaluated, since they feel that relying on one source of informa- 
tion poses . potentially unfair and invalid assessment of their instructional 

effectiveness. In order to alleviate this problem It Is Incumbent upon- 

instructional evaluators to develop multiple sources of evaluative Information 

on the basic components of the Instructional setting. 



The first step would be to define what sources of evaluative information ' 
could be used for each of the nine basic components enumerated above. The 
instruc tional ^an component can be evaluated by the instructor and a depart- 
mental peer (colleague) review committee using well developed criteria andt> 
guidelines. Students would be able to evaluate only those parts of the instruc- 
tional plan that inUructors formally made them aware of, such as the objectives 
of the course and the Instructor's expectations regarding their p^H^ormance. 
Such statements as: . 

"The objectives of the course were well explained", 
"What was expected of me 1n this course was NOT always clear", and 
"The instriuctor's expectations were NOT clearly defined" 
would represent appropriate student evaluations of certain aspects of tJie 
instructor's" instructional plan. • 

The i nstructional materials component can be evaluated by the Instructor, 
a departmental peer review committee and the„studentS. The Instructor would ' 
evaluate this from the point of view o^^Ms/her rati oWe-for selecting and - 
using such materials and whether such materials can effectively be used to 
stimulate student learning. The departmental] peer review conmlttee would 
evaluate this from the point of view of -appropriateness, up-to-datedness. 
relevancy, etc. The students would evaluate this from the point of view of 
worthwhileness, difficulty, 'interest value, etc. Such statements as 
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"The course material was top difficult", and 

"The course material Was Interesting" 
would represent appropriate student evaluations of the Instructional materials * 
component. 

The instructional methods component can be evaluated by the instructor, 
a departmental peer review committee and the students. The Instructor would 
evaluate this from the point of view of his/her rationale for selecting and 
using such methods and perceived effectiveness of such methods.^ The depart- 
mental Reer review committee would evaluate this from the point of view of 

appropriateness, Innovatlveness, etc. The students would evaluate this from 

J- 

the point of view of learning value, motivational value, comparative effective- 
ness, etc. Such statements as " 

"I would preferred another method of teaching 1n this course", 

"I learn more when other teaching^ methods are used", 

"A good'mixturr of lecture and discussion was present during class", and 

"The course stimulated me to read further In this area" 
would represent appropriate student evaluations of the Instructional methods 
component. . * 

The Instructional examinations component can be evaluated by the Instructor, 
a departmental peer review committee arid the students. The Instructor would 
evaluate this from the point of view of number, difficulty- level , accuracy, 
learning value, etc. The departipental peer review committee would evaluate, 
this from the polnt'of view of .diff icul ty level ,. accnracy, adequacy, learning 
walue, representativeness, etc. The students would "evaluate this from the 
point of view of difficulty level, representativeness, length, etc. Such 
statements as ' 
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"Examinations were too difficult", 

"Examinations were mainly comprised of material presented in class", and 
•.. "Enough time was provided to complete the examinations" 
would represent appropriate student evaluations of the^ instructional examinations 
component. - \. 

The Instructional evaluations component can be evaluated by the lifetruc- 
tor, a d€!j3artmental peer review committee and the students. The 'instructor 
would evaluate this from the point of view of his/her rationale for the 
-particular evaluation scheme, how standards were determined, what alternatives 
are available to the students, etc;. The departmental peer review coranlttee 
would evaluate thls^Vom the p61nt of view of appropriateness, fairness, 
objectivity, accuracy in relation to the measurement data, etc' The students 
would evaluate this from the point of view of fairness, objectivity, relation 
to what was learned, etc. "Such statements'as 

"The procedure for grading was fair", 

"The method of assigning grades seemed very arbitrary", and 

"I do not feel. that my grades reflected how much I have learned" 

would represent appropriate student evaluations of the instructional evaluations 

component. 

The student component of the Instructional setting Is most approorlately 
evaluated by both the ^Instructor and the students. The Instructor and the 
students would evaluate the students from the point of view of their Interest, 
attention, motivation, participation, level of learning, etc. Such statements 
as ^ 

"I deepened my Interest In the subject matter of this course", 
"I participated more in class discussions in this course than In 



similar courses", and . 

"I learned more 1n this course than In s1?i11ar courses'* ' ' * 

would represent appropriate student evaluations of the student component. 

The instructor^component of the Instructional setting is al^o most * 
appropriately evaluated by both the Instructor and students. The Instructor 
would evaluate Yrom the point of view of his/her perfonWInce, rapport wi"th 
the students, humor in the classroom, flexibility, receptivity, € to. The 
students would evaluate the instructor on the basis ofahis/her performance, 
humor, flexibility, interest, demonstrated knowledge, etc. Such statements a' 

"The instructor was very entertaining", 

"The instructor displayed a 'know-it-all' attitude", and ' "* 

"The instructor demonstrated a thorough knowledge of the subject matter" 

would represent appropriate student evaluations of the instructor comoonent" 

; 

The instructor-student interaction ecmponeht can be evaluated by thfe 
instructor, a departmental pefer review committee and thfe students*. The 
instructor would evaluate this from the point of view of his/her design, 
implementation and effectiveness of such an interaction. The departrteiital 
peer review committee would evaluate thi^ from the point of view of design, 
appropriate implementation, perceived effectiveness, etc. The^students would 
evaluate this from ,the point of view of question receptivity, clas#oom 
discussion, freedom to disagree, etc. Such statements as 

"The instructor encouraged the stud«tnts to ask questions", 

"1 participated actively in class discussions", and 

"Students in this course ffelt free to disagree"" 
would represent appropriate student evaluations of the instructor-student 
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intieractlon component. 
*'•'■' 

Finally, the instructional arena component can be evaluated by "thfr 

instructor, a departmental peer review conwnittee and the students. The 
instructor would evaluate 'thi.s from the point of view of adequacy 6f size, 
seating, blackboard , space, etc. The departmental peer review committee 
would, evaluate this from the point of view pf appropriateness of size, seating,' 
blackboard space, etc. The students would evaluate this from the point of 
view of appropriateness of si zer seating, blackboard space, etc. Such 
statements as 

"The classroom created a cramped atmosphere". 



"The seats were very uncomfortable'?, and 
, "The location of the blackboard made it easy to take notes" 
would represent appropriate student evaluations of the instructional arena 
, component. • 
.. ' '' . 

In summary, if one defines the instructional setting as consisting of 
*the nine components described 'above then\irt3lt1ple sources of evaluative ... 
Information would be necessary to assess instructional effectiveness!' 
Although pnly three sources (Instructor, departmental peer review con|^ittee and 
student) were Identified, others could be Included. The description of the \ 
criteria each sour'ce would use in evaluating Instructional effectiveness for \ 
each component of the Instructional setting were basically quite similar, 
however, the pnecise methods, guidelines and perspective, of each source would -^^ 
not necessarily be similar. For this reason it is imperative that when one 
solicits student input that the statements be appropriate to what the students 
are in a position to evaUjate. This paper presented examples of appropriate 
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Evaluative statements- to present to students so as not to confuse their 
input with that of the instructor and departmental peer review camiittee; 
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